Simultaneous Computational and Data Load Balancing in Distributed-Memory Setting
نویسندگان
چکیده
Several successful partitioning models and methods have been proposed used for computational load balancing of irregularly sparse applications in a distributed-memory setting. However, the literature lacks that encode both data balancing. In this article, we try to close gap by proposing two hypergraph (HP) which simultaneously Both utilize two-constraint formulation, where first constraint encodes loads second loads. model, introduce explicit vertices encoding replicate those at each recursive bipartitioning (RB) step replication. weight distribution scheme update weights RB step. The nice property is they do not necessitate developing new partitioner from scratch. can easily be implemented invoking any HP tool supports multiconstraint as two-way validity are tested on widely applications: parallel mesh simulations matrix multiplication. achieve significant improvement over baseline model.
منابع مشابه
Load Balancing in a Distributed-Memory Or-Parallel System
We consider or-parallel logic programming implementations on parallel machines with no shared-memory. Traditional implementation techniques as employed in Aurora and Muse are not applicable. In our orparallel execution model, all processors perform identical work initially. At each choice point, processors are divided evenly among alternatives of the choice point. Backtracking is employed if th...
متن کاملFeedback guided load balancing in a distributed memory environment
Feedback guided dynamic load balancing is the process of equilibrating the load of all the processors of a system during execution time based on information gathered from them. It provides better execution times by better utilizing the systems resources. In this work we have suggested a new dynamic load balancing model, named Wave Propagation Model, that is based on the diffusion balancing meth...
متن کاملFeedback Guided Load Balancing in Distributed Memory Environments ——————————– Masters Dissertation
Any code that parallelizes computational work is required to come up with a method to load balance the work across the available processors. Most codes of this nature use some heuristic to decide how to perform this load balancing. In essence, they must have a (cheap) method of coming up with a number to act as a proxy for dividing up the actual computational work. For some applications that us...
متن کاملMapping and load balancing on distributed memory systems
Two kinds of tools are necessary to optimise the use of available resources by the execution of parallel programs on distributed memory systems: mapping and load balancing tools. A mapping tool is well suited for programs whose behaviour is predictable while for many "real applications", it needs to be complemented by a dynamic load balancing tool. Both tools are currently investigated to be in...
متن کاملLoad Balancing with Memory
A standard load balancing model considers placing n balls into n bins by choosing d possible locations for each ball independently and uniformly at random and sequentially placing each in the least loaded of its chosen bins. It is well known that allowing just a small amount of choice (d = 2) greatly improves performance over random placement (d = 1). In this paper, we show that similar perform...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: SIAM Journal on Scientific Computing
سال: 2022
ISSN: ['1095-7197', '1064-8275']
DOI: https://doi.org/10.1137/22m1485772